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AMENDMENTS TO THE CLAIMS 

The following Listing of Claims, with amendment to claims 1,12 and 21 , will replace all 
prior versions, and listings, of claims in the application. No new matter is introduced as a 
result of the following claim amendments. 

Listing of Claims: 

1 (Currently Amended). A physical computer-readable medium having stored thereon 
computer executable instructions for automatically constructing an image mosaic from a 
set of images of a scene, said computer executable instructions comprising: 

inputting a set of images of a scene; 
registering the set of images; 

comparing the set of images to identify areas of difference between the images for 
all images, said areas of difference representing regions of potential occlusion in each 
image , wherein an occlusion represents an area in any of the images that is at least 
partially obstructed from view by one or more objects in one or more of the other images ; 

determining, for each image, whether regions of potential occlusion in each image 
represent actual regions of occlusion, or whether the regions of potential occlusion in each 
image represent regions of non-occlusion, by determining a level of discontinuity along an 
exterior border of each region of potential occlusion in each image; and 

creating a mosaic image by replacing at least one actual region of occlusion in one 
image from the set of images with corresponding regions of non-occlusion from at least 
one other image from the set of images of the scene. 

2 (Original). The computer-readable medium of claim 1 wherein registering the images 
comprises at least one of translating the images, rotating the images, scaling the images 
and warping the images, for aligning the images. 
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3 (Original). The computer-readable medium of claim 1 further comprising cropping the 
images after registering the set of images so that all images cover approximately the same 
view of the scene. 

4 (Original). The computer-readable medium of claim 1 further comprising balancing the 
set of images. 

5 (Original). The computer-readable medium of claim 4 wherein balancing the images 
comprises histogram averaging of the images based on corresponding targets for each 
image. 

6 (Original). The computer-readable medium of claim 4 wherein balancing the images 
comprises white balancing the images based on corresponding targets for each image. 

7 (Original). The computer-readable medium of claim 1 wherein comparing the set of 
images to identify areas of difference between the images for all images further comprises 
comparing corresponding blocks of image pixels between each image to determine 
whether the corresponding blocks match. 

8 (Original). The computer-readable medium of claim 1 wherein comparing the set of 
images to identify areas of difference between the images for all images further comprises 
automatically constructing at least one image mask for identifying non-occluded regions 
and regions of potential occlusion in the set of images. 

9 (Previously Presented). The computer-readable medium of claim 7 determining whether 
the corresponding blocks match further comprises determining whether the corresponding 
blocks match within a predetermined matching threshold. 

10 (Original). The computer-readable medium of claim 1 wherein replacing at least one 
actual region of occlusion in one image from the set of images with corresponding regions 
of non-occlusion further comprises at least one of blending, feathering, and pixel 
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averaging, along the edge of the corresponding regions of non-occlusion used to replace 
any actual regions of occlusion. 

1 1 (Original). The computer-readable medium of claim 1 further comprising a user 
interface for excluding one or more actual regions of occlusion from being replaced with 
corresponding regions of non-occlusion. 

1 2 (Currently Amended). A system for removing occlusions from a composite image 
formed from a set of images of a scene, comprising: 

acquiring at least two images of a scene from approximately the same viewpoint; 

aligning each of the images to a base image selected from the set of images; 

identifying areas of potential occlusion in each of the aligned images , wherein an 
occlusion represents an area in any of the images that is at least partially obstructed from 
view by one or more objects in one or more of the other images ; 

selecting a seed image from the set of images; 

determining whether each area of potential occlusion in the seed image is an actual 
area of occlusion by examining each area of potential occlusion in the seed image to 
determine whether a level of discontinuity along an outer edge of each area of 
discontinuity exceeds a predetermined threshold; 

replacing areas of actual occlusion in the seed image with corresponding non- 
occluded areas from one of the other images in the set to form a composite image from the 
seed image. 

13 (Original). The system of claim 12 wherein the system is embedded in a digital camera. 

1 4 (Original). The system of claim 1 2 wherein aligning each of the images to the base 
images comprises applying a geometric transform to each image relative to the base 
image for registering each of the images to the base image. 

15 (Original). The system of claim 14 further comprising individually cropping each image 
so that all images cover approximately the same view of the scene. 
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1 6 (Original). The system of claim 1 2 further comprising balancing the images by applying 
any of histogram averaging of the images based on corresponding targets for each image, 
and white balancing of the images based on corresponding targets for each image. 

17 (Original). The system of claim 12 wherein identifying areas of potential occlusion in 
each of the aligned images further comprises dividing each image in the set of images into 
a number of pixel blocks, and comparing corresponding pixel blocks between each image 
to determine whether the corresponding blocks match within a predetermined threshold. 

18 (Original). The system of claim 12 wherein identifying areas of potential occlusion in 
each of the aligned images further comprises a pixel-by-pixel comparison of corresponding 
pixels between each image to determine whether the corresponding pixels match within a 
predetermined threshold. 

19 (Original). The system of claim 12 wherein identifying areas of potential occlusion in 
each of the aligned images further comprises automatically constructing an image mask 
for identifying all regions of potential occlusion in the set of images. 

20 (Original). The system of claim 12 wherein replacing areas of actual occlusion in the 
seed image with corresponding non-occluded areas from one of the other images in the 
set further comprises at least one of blending, feathering, and pixel averaging an outer 
edge of the corresponding non-occluded areas with respect to the seed image. 

21 (Currently Amended). A computer-implemented process for removing occlusions from 
a mosaic image created from a set of images of a scene, comprising: 

inputting a set of two or more images of a scene; 

aligning each of the images to a base image selected from the set of images; 

comparing each of the aligned images to identify areas of potential occlusion in 
each of the aligned images , wherein an occlusion represents an area in any of the images 
that is at least partially obstructed from view by one or more objects in one or more of the 
other images ; 
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determining a level of discontinuity along an outer edge of each area of potential 
occlusion for each image, said level of discontinuity indicating an area of actual occlusion 
where the level of discontinuity exceeds a predetermined discontinuity threshold, and said 
level of discontinuity indicating an area of non-occlusion where the level of discontinuity is 
less than the predetermined discontinuity threshold; 

creating an image mask for each image, said image masks indicating areas of 
occlusion and areas of non-occlusion for each image; and 

using the image mask for each image for creating a mosaic image by replacing 
areas of actual occlusion in one of the images with corresponding areas of non-occlusion 
from one of the other images. 

22 (Original). The computer-implemented process of claim 21 wherein the computer is 
integral to a digital camera, and wherein the composite image is formed automatically from 
images of a scene captured using the digital camera. 

23 (Original). The computer-implemented process of claim 21 wherein replacing areas of 
actual occlusion in one of the images with corresponding areas of non-occlusion from one 
of the other images further comprises blending pixels along an outer edge of the 
corresponding areas of non-occlusion with pixels surrounding the areas of actual occlusion 
being replaced. 

24 (Original). The computer-implemented process of claim 21 wherein replacing areas of 
actual occlusion in one of the images with corresponding areas of non-occlusion from one 
of the other images further comprises feathering pixels along an outer edge of the 
corresponding areas of non-occlusion with pixels surrounding the areas of actual occlusion 
being replaced. 

25 (Original). The computer-implemented process of claim 21 wherein replacing areas of 
actual occlusion in one of the images with corresponding areas of non-occlusion from one 
of the other images further comprises averaging pixels along an outer edge of the 
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corresponding areas of non-occlusion with pixels surrounding the areas of actual occlusion 
being replaced. 

26 (Original). The computer-implemented process of claim 21 further comprising balancing 
the set of images after registering the set of images. 

27 (Original). The computer-implemented process of claim 26 wherein balancing the 
images comprises histogram averaging of the images based on corresponding targets for 
each image. 

28 (Original). The computer-implemented process of claim 26 wherein balancing the 
images comprises white balancing the images based on corresponding targets for each 
image. 
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